DURIP  Final  Report 

A  Hardware-in-the-Loop  Experiment  and 
Simulation  Facility  for  Vision-Based 
Control  of  Micro- Air- Vehicles 

February  2005 


Technical  Officer :  Dr.  Spencer  Wu 

Air  Force  Office  of  Scientific  Research 
ATTN:  NI/DURIP 
4040  N.  Fairfax  Drive,  Suite  500 
Arlington,  VA  22203-1613 


Investigators  :  Andrew  J.  Kurdila,  Professor,  Principal  Investigator 

Peter  I^u,  Associate  Professor 
Rick  Lind,  Assistant  Professor 
Michael  Nechyba,  Assistant  Professor 

Department  of  Mechanical  and  Aerospace  Engineering 
Department  of  Elwtiicd  and  Computer  Engineering 
Umversity  of  Florida 
Gainesville,  FL  3261 1-6250 
(352)  392-7005 


20050309  077 

_ y 


V 


REPORT  DOCUMENTATION  PAGE 


The  public  reporting  burden  for  this  collection  of  information  is  estirnated  to  average  1  hour  per  response,  including  the 
gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  rej 
information,  including  suggestions  for  reducing  the  burden,  to  Department  of  Defense,  Washington  Headquarters  Services, 
1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington,  VA  22202-4302.  Respondents  should  be  aware  that  notwithstar 
penalty  for  failing  to  comply  with  a  collection  of  information  if  it  does  not  display  a  currently  valid  0MB  control  number. 

PLEASE  DO  NOT  RETURN  YOUR  FORM  TO  THE  ABOVE  ADDRESS. _ 


^JfRL-SR-AR-TR-05- 


1.  REPORT  DATE  fOD-MM-yyyyj 


2.  REPORT  TYPE 


Final 


3.  DATES  COVERED  {From  -  To) 

1  June  2003  -  30  September  2004 


4.  TITLE  AND  SUBTITLE 

A  Hardware-in-the-Loop  Experiment  and  Simulation  Facility  for  Vision- 
Based  Control  of  Micro- Air- Vehicles 


I  5a.  CONTRACT  NUMBER 


iBbTORANT  NUMBER 


F49620-03-1-0327 

5c.  PROGRAM  ELEMENt  NUMBER 

6.  AUTHOR(S) 

Andrew  J.  Kurdila 

Peter  I§u 

Rick  Lind 

Michael  Nechyba 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Department  of  Mechanical  and  Aerospace  Engineering 

University  of  Florida 

Gainesville,  FL  3261 1  -6250  j. 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME{S)  AND  ADDRESS(ES} 

Air  Force  Office  of  Scientific  Research 

4015  Wilson  Blvd 

Mail  Room  713  . 

Arlington,  VA  22203  Kj  V  X  1 

10.  SPONSOR/MONITOR'S  ACRONYM(S) 

AFOSR 

11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Distribution  Statement  A.  Approved  for  public  release;  distribution  is  unlimited. 


13.  SUPPLEMENTARY  NOTES 


14.  ABSTRACT 

This  report  documents  research  performed  under  the  contract  entitled  “A  Hardware-in-the-Loop  Experiment  and  Simulation  Facility 
for  Vision-Based  Control  of  Micro-Air-Vehicles  (MAVs).”  This  experimental  facility  is  comprised  of  two  major  components  -  a 
wind  tunnel  facility  and  a  real-time  virtual  image  generation  system.  Collectively,  these  two  components  form  a  unique  closed-loop 
test  for  studying  vision-based  control  of  autonomous  flight  vehicles.  The  most  important  milestone  achieved  last  year  was  the 
design  and  construction  of  the  new  visualization  laboratory.  This  laboratory  is  equipped  to  display  virtual  environments  for  MAV 
flight  simulations.  Currently,  a  University  of  Florid  campus  database,  developed  by  the  UF  Digital  Worlds  Institute,  is  being  used  as 
the  virtual  environment  for  studying  vision-based  control  of  MAVs  in  urban  environments.  This  report  provides  a  description  of  the 
new  visualization  laboratory  and  the  virtual  UF  campus  database. 


15.  SUBJECT  TERMS 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 
ABSTRACT 

18.  NUMBER 
OF 

PAGES 

19a.  NAME  OF  RESPONSIBLE  PERSON 

a.  REPORT 

b.  ABSTRACT 

c.  THIS  PAGE 

Andrew  J.  Kurdila 

U 

u 

U 

uu 

19b.  TELEPHONE  NUMBER  (Include  area  code) 

352-392-7005 

Standard  Form  298  {Rev.  8/98) 

Prescribed  by  ANSI  Std.  Z39.18 


1  Introduction 


This  report  documents  research  performed  under  the  contract  entitled  “A  Hardware-in-the-Lx5op  Ex¬ 
periment  and  Simulation  Facility  for  Vision-Based  Control  of  Micro- Air- Vehicles  (MAVs).”  This 
experimental  facility  is  comprised  of  two  major  components  -  a  wind  tunnel  facility  and  a  real-time 
virtual  image  generation  system.  Collectively,  these  two  components  form  a  unique  closed-loop  test 
facility  for  studying  vision-based  control  of  autonomous  flight  vehicles. 

The  most  important  milestone  achieved  last  year  was  the  design  and  construction  of  the  new 
visualization  laboratory.  This  laboratory  is  equipped  to  display  virtual  environments  for  MAV  flight 
simulations.  Currently,  a  University  of  Florida  campus  database,  developed  by  the  UF  Digital  Worlds 
Institute,  is  being  used  as  the  virtual  environment  for  studying  vision-based  control  of  MAVs  in  urban 
environments.  This  report  provides  a  description  of  the  new  visualization  laboratory  and  the  virtual 
UF  campus  database. 

Additionally,  the  project  achieved  capabilities  for  hardware  in  the  loop  simulation  (HBLS).  The 
visualization  laboratory  was  augmented  with  a  wind  tunnel  through  interface  instrumentation.  This 
instrumentation  allows  a  aerodynamic  data,  such  as  forces  and  moments  measured  on  a  MAV  mounted 
in  the  tunnel,  to  be  used  in  simulating  flight  through  the  virtual  environment.  The  combination  of 
theoretical  modeling  and  experimental  measuring  provides  a  powerful  utility  for  realistic  simulations. 


2  Year  1  Progress 

2.1  Visualization  Laboratory 

The  visualization  facility  consists  of  a  virtual  environment  displayed  on  three  rear-projected  video 
screens.  The  UF  Digital  Worlds  Institute,  headed  by  Dr.  James  Oliverio  and  Dr.  Andy  Quay,  designed 
and  built  most  of  the  hardware  system  for  the  virtual  environment.  The  virtual  environment  software 
is  built  upon  MultiGen-Paradigm’s  distributed  VEGA,  which  enables  the  loading  of  vuban  databases 
and  synchronizes  the  three  video  screens  driven  by  a  PC  image  cluster.  The  three-screen  display 
system  is  depicted  in  Figure  (1). 


Figure  1:  The  rear-projected  display  system  in  the  visualization  laboratory. 
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The  following  items  were  purchased  in  constructing  the  visualization  laboratory: 

•  12  PowerMac  G5  computers  (2  GHz  processor) 

•  Server  for  the  G5  cluster 

•  2  Dell  Optiplex  computers  (Pentium  4, 3  GHz  processor 

•  1 1  Dell  workstations 

•  13  NVidia  Quadro  3(X)0  video  cards 

•  MultiGen  Paradigm  3  year  educational  site  license 

•  Multimedia  (DVD  and  VCR) 

•  1  Digital  Camera 

•  \^deo  Switcher 

•  Projection  system 

•  Miscellaneous  cabling  and  adapters 

•  Laboratory  infrastructure:  cabinets,  carpeting,  etc. 

A  schematic  layout  of  the  visualization  laboratory  is  given  in  Figure  (2).  The  figure  shows  the  inter¬ 
connection  between  the  image  generation  system  with  rear-projection  display  and  the  vision  process¬ 
ing  and  flight  control  system.  Also  shown  is  the  mounting  of  the  MAV  with  digital  camera  in  front  of 
the  display  screen. 


Figure  2:  Conceptual  layout  of  the  visualization  facility. 
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Finally,  the  software  architecture  of  the  visualization  facility  is  depicted  in  Figure  (3).  The  inter¬ 
relationships  of  the  various  elements  associated  with  displaying  a  virtual  environment  are  shown  in 
the  figure.  Basically,  an  urban  database  is  stored  and  rendered  according  to  the  position  of  the  MAV  in 
the  virtual  environment.  This  is  accomplished  using  the  MultiGen  software  which  also  incorporates 
any  special  effects  such  as  reflections  and  shadowing.  The  distributed  rendering  utilities  ensure  that 
the  three  displays  are  synchronized  since  individual  views  are  typically  rendered  at  different  rates. 
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Figure  3:  Software  architecture  of  the  visualization  facility. 


2.2  Virtual  Environment  Database 

The  visualization  laboratory  currently  displays  a  UF  campus  database  that  was  developed  by  the 
Digital  Worlds  Institute.  This  database  contains  high-resolution  imagery  of  the  exteriors  of  most  of 
the  buildings  on  the  UF  campus  and  will  serve  as  the  main  virtual  environment  for  testing  vision- 
based  control  algorithms  for  MAVs.  In  the  future,  the  database  will  be  updated  to  provide  more 
exterior  details  as  well  as  views  of  some  building  interiors.  The  UF  campus  database,  displayed  in  the 
Research,  Education  and  Visualization  Environment  (REVE)  at  the  Digital  Worlds  Institute,  is  shown 
on  the  right  in  Figure  (4). 

It  should  be  noted  that  the  visualization  facility  currently  has  the  ability  to  display  three  camera 
views.  These  can  be  continuous  views  such  that  the  three-screen  display  shows  one  panoramic  image, 
as  illustrated  in  Figures  (1)  and  (4).  Alternatively,  they  can  be  completely  separate  views  as  might 
be  seen  from  3  different  MAVs  in  the  environment.  Figure  (5)  illustrates  two  virtual  images  from  a 
single  camera  view  during  a  simulated  MAV  flight  through  the  campus  database. 
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Figure  4:  UF  campus  database  displayed  in  the  REVE  at  the  UF  Digital  Worlds  Institute. 


Figure  5;  Virtual  images  from  a  simulated  MAV  flight  through  the  UF  campus  database. 


23  Interface  . . —  - —  . 

Over  the  past  one  and  a  half  years  the  University  of  Florida  has  made  great  strides  in  modernizing  the 
wind  tunnel  facilities  to  perform  experiments  on  micro  air  vehicles.  The  current  facility  is  an  open 
loop  tunnel  that  has  a  3  foot  by  3  foot  test-section  and  limited  airspeed  (up  to  30  miles/hour).  In 
March,  a  new  tunnel  will  be  installed  having  two  test-sections,  a  2  foot  by  2  foot  test  section  and  a 
3  foot  by  3  foot  test-section.  In  the  smaller  test  section,  air  speeds  up  to  200  miles  per  hour  will  be 
possible. 

A  great  deal  of  effort  has  been  spent  on  instrumentation  and  data  acquisition  and  evaluating  new 
instrumentation.  Photographs  of  the  tunnel  are  provided  in  Figme  6  and  7. 

•  The  visual  image  correlation  (VIC)  system  measures  the  deformed  shapes  of  our  flexible  wings 
in  the  wind  tunnel.  The  system  has  been  used  to  document  the  displacements  and  strains  on  a 
full-field  basis  on  our  flexible  wings.  It  has  also  been  used  to  document  the  deformed  shapes 
of  morphed  wing  aircraft  in  situ.  The  VIC  system  combined  with  the  wind  tunnel  is  a  unique 
facility.  It  is  believed  to  be  the  only  one  of  its  kind  in  the  world. 

•  The  dynamic  pitch  mechanism  replaces  the  typical  sting  balance  mount.  It  is  capable  of  pitching 
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Figure  6:  Wind  tunnel  and  instrumentation. 

the  MAV  or  wing  without  moving  vertically  in  the  tunnel.  It  rotates  the  MAV  about  its  center 
of  gravity.  It  is  capable  of  2  Hertz  at  45  degree  amplitude. 

•  The  dynamic  gust  mechanism  is  built  into  the  current  wind  tunnel  and  is  capable  of  producing 
pulsating  flow  up  to  5  Hertz  with  amplitude  on  the  order  to  30%  of  mean  airspeed.  This  device  is 
used  to  simulate  head-on  wind  gusts.  We  use  the  results  to  tune  the  adaptive  washout  mechanism 
on  our  wings. 

•  The  small  sting  balance  was  purchased  and  installed  for  MAV  testing.  The  balance  is  the 
smallest  commercially  available  model  from  Aerlabs  Inc..  It  is  capable  of  measurements  of 
force  on  the  order  of  1  gram  in  all  directions.  It  has  enough  resolution  to  characterize  vehicles 
on  the  ordw  to  6  inches  and  laiger  . 

•  The  particle  image  velocimetry  system  is  operational  in  the  current  wind  tunnel.  Although  this 
piece  of  equipment  was  available  prior  to  our  focus  on  MAV s,  it  is  operational  and  we  plan  to 
use  it  for  flow  documentation. 

•  The  data  acquisition  and  automation  system  from  National  Instruments  has  been  installed  in 
'  the  tunnel.  TTie  dynamic  pitch  mechanism  and  sting  balance  are  currently  automated  to  sweep 

through  the  angle  of  attack  range.  Aircraft  system  ID  has  been  performed  on  a  number  of 
vehicles  including  those  that  have  autopilots. 
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Dynamic  pitch  mechanism 


Figure  7:  Sting  balance  and  dynamic  pitch  mechanism. 
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Figure  8:  Deformed  wing  in  the  wind  tunnel  using  VIC  system. 
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